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(57) Abstract 

A data processing system implements a security protocol based on processing data in packets. The data processing system comprises 
packet processing means (301) for storing filter code (304) and processing data packets according to stored filter code, and policy managing 
means (305) for generating filter code and communicating generated filter code to the packet processing means (301). The packet processing 
means (301) is arranged to examine, whether the stored filter code is applicable for processing a certain packet. If the stored filter code is 
not applicable for the processing of a packet, the packet is communicated to the policy managing means (305). which generates filter code 
applicable for the processing of the packet and communicates the generated filter code to the packet processing means (301). 
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Methyl and Arrangement for ImplemenUng IPSEC Policy Management using 
Filter Code 

The invention relates to Ae field of implementing protocols that authenticate and 
5 enciypt/deciyptpacketised digital information. 

The IP security protocol (IPSEC) is being s^mdardized by the IETF (Internet 
I^tneering T^k Force) for adding security to the well-known and widely used IP 
p^orn provides cryptographic authendcadon and confiden^a,^ of ^affic 
breen two comn-umcating network nodes. 1. can be used m both end-to-end 
,0 "e directly between the communicating nodes or hosts, or m tunnel n^de 
r:teen feewaUs or VPN (Virtual Private Ne^ork) <le.ce. ^ymmem 
c„m,ections, where one end is a host and the otirer end ts a firewall or VPN are also 
possible. 

IPSEC defines a set of operations for performing authentication and encryption <m 
,5 TcS ltd by adding nL protocol headers to each packet. IPSEC auth-tioati- 
of aiu packet is performed by computing an auflrentication code over all data and 
ls."header of the data packet. The authentication code fintiter depends on a 
Tc^t key known only «. the communicating parties. The autiienttcatton code ts 
7^117^ in the packet, appropriately wrapped in a well-defined header or tratler. 

,n The operations to be performed on each packet are controlled by a policy that 
;':rXh authenUon and encryption methods, jointiy caUed — . 
^e to be applied between each pair of commmucatmg hosts. The P^^'' 
Tpec^Us ^cryptographic algoritimts. cryptographic keys, and o«J- 
,„ securely processing packets between two hosts or peers .s called a secunty 
25 association. 

A certain poUcy is typically expressed as a set of poUcy rules, each rule specifying a 
^."mrs (sulas source IP address, destination IP address, »bne, Pro^co ; 
„ort nuntber, destination port number) constraining tite commumcanonor ^ 
ofTom^unications to which tire rule applies. Several rules may apply to a p^«^la^ 
30 packet, and there is normally a mumal order of the mles so tiutt a smgle rule can be 
miambigaously chosen for each incoming and outgomg packet 
The IPSEC standard and published implementations present a data strucmre caUed 
the policy database, which is an array or table in memory and contams rules. The 
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rules in the policy database are consulted for each packet to be processed. Fig. 1 is a 
simplified graphical illustration of a known IPSEC implementation 100, which 
contains a policy database 101 and separates a secure internal network 102 from the 
Intemet network 103. For the sake of simplicity, packets flowing only to one 

5 direction (outgoing packets) are considered. The input packets 104 in Fig. 1 contain 
data that a user in the internal network 102 wants to send to another user through 
the Intemet and that need to be processed for authentication and encr5q)tion. In the 
IPSEC implementation an input packet under consideration 105 is transformed into 
an output packet under consideration 106 by consulting the rules in the policy 

10 database 101. The transformed output packets 107 are then sent into the Intemet, 
where they will be properly routed to the correct receiving user. 

On the other hand, mechanisms for filtering IP packets have been available and 
well-known in the literature for a long time. Suitable mechanisms are presented for 
example in J. Mogul, R. Rashid, M. Accetta: "The Packet Filter: An Efficient 

15 Mechanism for User-Level Network Code" In Proc. Uth Symposium on Operating 
Systems Principles, pp 39-51, 1987 and Jeffrey Mogul: "Using screend to 
implement IP/TCP security policies". Digital Network Systems Laboratory, NSL 
Network Note NN-16, July 1991. Packet filters also have a set of rules, typically 
combined by a set of implicit or explicit logical operators. The task of a packet filter 

20 is to either accept or reject a packet for further processing. 

The logical rules used in packet filters take the form of simple comparisons on 
individual fields of data packets. Effectively, effecting a such comparison takes the 
form of evaluating a boolean (logical, truth value) expression. Methods for 
evaluating such expressions have been well-known in the mathematical literature for 
25 centuries. The set of machine-readable instractions implementing the evaluations is 
traditionally called the filter code. Fig. 2 illustrates a packet filter 200 with a stored 
filter code 201. Input packets 202 are examined one packet at a time in the packet 
filter 200 and only those packets are passed on as output packets 203 that produce 
correct boolean values when the logical rules of the fdter code are applied. 

30 The individual predicates (comparisons) of packet filter expressions typically 
involve operands that access individual fields of the data packet, either in the 
original data packet format or from an expanded format where access to individual 
fields of the packet is easier. Methods for accessing data structure fields in fixed- 
layout and variable-layout data stmctures and for packing and unpacking data into 

35 stmctures have been well-known in standard programming languages like fortran. 
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cobol and pascal, and have been commonly used as programming techniques since 
1960*s. 

The idea of using boolean expressions to control execution, and their use as tests are 
both parts of the very basis of all modem programming languages, and the 
5 technique has been a standard method in programming since 1950's or earlier. 

Expressing queries and search specifications as a set of rules or constraints has been 
a standard method in databases, pattern matching, data processing, and artificial 
intelligence. There are several journals, books and conference series that deal vsdth 
efficient evaluation of sets of rules against data samples. These standard techniques 
10 can be applied to numerous kinds of data packets, including packets in data 
communication networks. 

A fiuther well-known technique is the compilation of programming language 
expressions, such as boolean expressions and conditionals, into an intermediate 
language for faster processing (see, for example, A. Aho, R. Sethi, J. Oilman: 
15 "Compilers - Principles, Techniques, and Tools", Addison-Wesley, 1986). Such 
intermediate code may be e.g. in the form of trees, tuples, or interpreted byte code 
inslructions. Such code may be structured in a number of ways, such as register- 
based, memory-based, or stack-based. Such code may or may not be allowed to 
perfom memory allocation, and memory management may be explicit, requiring 
20 separate allocations and frees, or impUcit, where the run-time system automatically 
manages memory through the use of garbage collection. The operation of such code 
may be stateless between applications (though carrying some state, such as the 
program counter, between individual intermediate language instructions is always 
necessary) like the operation of the weU-known unix program "grep"> and other 
25 similar programs dating back to 1960s or earlier. The code may also carry a state 
between invocations, hke the weU-known unix program "passwd", most database 
programs and other similar applications dating back to 1960s or earlier. It may even 
be self-modifying like many Apple H games in the early 1980s and many older 
assembly language programs. It is further possible to compile such intermediate 
30 representation into directiy executable machine code for further optimizations. All 
this is well-known in the art and has been taught on university programming 
language and compiler courses for decades. Newer weU-known research has also 
presented methods for incremental compUation of programs, and compiling portions 
of programs when they are first needed. 
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Real-time filtering of large volumes of data packets has required optimization in the 
methods used to manipulate data. Thus, the standard programming language 
compilation techniques have been applied on the logical expression interpretation of 
the rule sets, resulting in intermediate code that can be evaluated faster than the 
5 original rule sets. A particular implementation of these well-known methods used in 
the BSD 4.3 operating system has been mentioned in popular university operating 
system textbooks and has been available in sample source code that has been 
accessible to students in many universities since at least year 1991. 

Recently, a patent application was filed for the well-known methods of stateless and 
10 statefiil filtering; a US patent was consequently granted vntii the number 5 606 668. 
"Stateless filtering" is essentially the well-known BSD 4.3 packet filter (University 
of Califoroia, Berkeley, 1991, published for royalty-firee worldwide distribution e.g. 
in the 4.3BSD net2 release), and "stateful filtering" adds to that what Aho, Sethi, 
and Ullman (1987, above) characterize on page 401 with "This property allows the 
15 values of local names to be retained across activations of a procedure. That is, 
when control retums to a procedure, the values of the locals are the same as they 
were when control left the last time." The particular book was probably the most 
popular textbook in university imdergraduate compiler courses in late 1980s and 
early 1990s. The idea itself dates decades back. 

20 A known IPSEC implementation must consult the policy database for every packet 
transmitted through the IPSEC implementation. High-speed VPN (Virtual Private 
Network) implementations, for instance, may need to process tens of thousands of 
packets per second. The processing overhead consisting of looking up for poUcy 
rules firom a database for such packets will soon become a bottieneck of 

25 performance. 

The incoming packets to a network device implementing the IPSEC method may be 
classified into regular and non-regular packets. The difference between the two is 
elaborated in more detail below. The invention resides in properly partitioning and 
arranging the tasks of 

30 - generating and maintaining policy databases, 

- based on the information in the policy databases, compiling filter code to be 
applied on packets, 

- using the compiled filter code for separating non-regular packets fi-om regular 
packets, and potentially processing regular packets, and 
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- creating new pieces of compiled filter code as a potential response to each 
occurrence of a non-regular packet. 

The novel features which are considered as characteristic of the invention are set 
forth in particular in the appended claims. The invention itself however, both as to 
5 its consLtion and its method of operation, together with additional objects and 
advantages thereof, will be best understood firom the following descnption of 
specific embodiments when read in comiection with the accompanymg drawmgs. 

Fig. 1 illustrates a known IPSEC implementation. 
Fig. 2 illustrates a known packet filter, 
10 Fig. 3 iUustrates an advantageous embodiment of the invention. 

Fig. 4 iUustrates details of information stored according to the invention. 
Fig. 5 is a flowchart representation of the method according to the invention 
and 

Figs. 6a and 6b iUustrate some physical implementations of the invention. 

,5 A device or process respomible for implementing the packet l;^^"":^^^^ 
according to the IPSEC meAod in a network device .s generally caUed an IPSEC 
packet processing engine" or an "IPSEC engine" for short Accordmg to *e 
Lvention, d.e operations to be performed on incoming and/or outgomg V^^^J^J 
be represented by means of a cer«un filter code, although the 

20 reqirements for a filter code in an IPSEC poUcy application ™- 
complicated than in the simple packet filtering case «=ferred to above m ae 
description of prior art A knov™ packet filter simply sorts incommg packe^ mto 
accepLe and non-acceptable packets. An IPSEC engine must *^ 
secu^ty poUcy. the currently active security associations and the transform 

25 betwe«, Loming and outgoing packets. AdditionaUy. the IPSEC engme must deal 
«ith secmity association creation and expiration and consult extemal key managers. 

to the invention. compUed filter code forms the core of the control logic of an 
IPSEC engine The filter code controls the processing of incommg and outgomg 
packets controls the appUcation of transforms applied to data packets, and makes 
30 policy decisions about packets to be dropped or passed without applying trm^fonns 
The filter code communicates with a separate poUcy manager that makes the actt^ 
poUcy decisions and generates new compUed filter code according to need. The 
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need for new compUed filter code potentially arises each time when the IPSEC 
engine receives a packet that it can not handle according to the existing compiled 
filter code. The pohcy manager then implements the poUcy for the packet causing 
the "trouble" and for similar fiiture packets. 

5 The compiled filter code effectively acts as a cache of recentiy made policy 
decisions, and any new decisions are referred to the more general poUcy manager 
code. This makes the difference between regular and non-regular packets evident: 
regular packets bear enough resemblance to some previously handled packet so that 
the IPSEC engine may apply the compiled filter code. A non-regular packet is the 

10 first of its kind to arrive into the IPSEC engine so that the compiled filter code does 
not contain enough information for its handling, whereby the policy manager must 
be consulted and new poUcy decision(s) must be made, which then become(s) part 
of the compiled filter code. The invention makes the processing of bulk data very 
efficient, yet it allows tiie full flexibiUly of a sophisticated, user-mode poUcy 

15 manager with arbitrary key management protocols and other features tiiat are 
impossible to implement using known packet filter solutions. The filter code also 
has an important role in making the system secure and robust; the filter code is in 
most cases able to drop and ignore invalid or unacceptable packets very fast, 
without needing to consult the poUcy manager. This helps against resource 

20 exhaustion attacks. The filter code also tightiy controls the application of 
transformations, preventing resource attacks by nested encryptions. 

An additional feature to improve robustness is tiiat die filter code is designed in 
such way that it will always terminate, even in the case tiiat an incorrect filter code 
is somehow generated. These features make tiie filter code particularly suitable for 
25 execution in an operating system kemel environment for maximal performance. The 
detailed procedure for ensuring termination is discussed more thoroughly below. 

The components of an IPSEC implementation 300 according to a first embodiment 
of tiie invention are roughly outiined in Figure 3. The IPSEC engine 301 interfaces 
witii a TCP/IP stack and/or network adapters generally represented by block 302 

30 using a packet interceptor 303 (known as such) which passes IP packets tiu-ough to 
tiie IPSEC engine for IPSEC processing. The IPSEC engine 301 performs packet- 
per-packet processing, such as choosing and applying cryptographic transformations 
on packets as generally described in known IPSEC literature. It also contains tiie 
filter code mechanism 304 described in this invention. A separate policy manager 

35 305 maintains tiie fiiU policy database 306 about acceptable communications and 
required autiientications, and makes policy decisions about how each packet is to be 
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handled. The key managers block 307 is a further functional entity that 
communicates with the policy manager 305 and performs on its behalf the actual 
key exchanges needed for the IPSEC authentication and/or encryption/decryption 
processes. The key managers block 307 may use in its operation any protocols 
known as such, e.g. the ISAKMP/Oakley protocol, where ISAKMP means hitemet 
Security Association Key Management Protocol. 

Different sections of the block diagram in Fig. 3 have different performance 
requirements. The packet interceptor 303 potentially sees every packet in the 
network, including both IP packets and packets according to other protocols. It must 
be able to separate IP packets from the other packets and pass them on to the IPSEC 
engine 301 at the full supported packet rate. The IPSEC engine 301 normally sees 
every IP packet, and it must be able to process these packets also at the fiiU 
supported packet rate. Both the packet interceptor 303 and the IPSEC engine 301 
typically reside in an operating system kernel 308 of the computerized network 
device where the IPSEC implementation 300 takes place to minimize 
communication costs. 

The poUcy manager 305 and the key manager 307 perform tasks that may take 
longer to complete than operations in the full-rate processing blocks 303 and 301. A 
typical examination of the poUcy database 306 by the policy manager 305 may 
involve looking at hundreds of individual rules, and may even involve 
communication with external hosts (not shown) to determine the appropriate pohcy 
in each case. Key exchanges effected by the key managers block 307 often take 
even longer than the policy database examinations, up to several seconds in some 
cases. The policy manager 305 and key managers block 307 also do not have very 
clearly defined resource requirements. It is thus most preferable to implement them 
as user-mode processes in the user-mode process space 309 of the network device. 

Communication between kernel-mode and user-mode processes in a general- 
purpose computer is fairly time-consuming, involving substantial overhead and data 
copying every time a message is passed. Thus it is desirable to reduce the amount of 
such communications. In an embodiment of the invention according to Fig. 3 this 
means reducing the amount of communication between the IPSEC engine 301 and 
the policy manager 305. The filter code mechanism 304 serves this purpose, 
because once a policy decision has been saved into the filter code mechanism in the 
form of compiled filter code, regular packets that can be handled according to that 
filter code cause no further transferring of messages between the IPSEC engine 301 
and the policy manager 305. 
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It is possible and sometimes desirable to implement even the IPSEC engine in user 
mode instead of the operating system kernel. However, due to the different response 
time requirements of the IPSEC engine and the policy manager, it is even then 
desirable to run them in separate threads or processes, which introduces more or 
5 less the same communication overheads as implementing the IPSEC engine in the 
operating system kernel. 

For the system according to the invention to work properly it is important to have a 
well-defined work distribution between the IPSEC engine and the policy manager. 
All packet processing that needs to be done separately for every data packet is 

10 located in the IPSEC engine. When a non-regular packet comes into the IPSEC 
engine, the policy decision about its handling is referred to the policy manager. The 
policy manager will then send informatilon to the IPSEC engine that allows it to 
make similar decisions on behalf of the policy manager concerning the following 
regular packets, until the policy manager sends new information to the IPSEC 

15 engine or some of the information expires. For example, in a typical TCP/IP 
session, the first packet in each direction vnU be a non-regular packet and gets 
passed to the policy manager, which will examine the packet and determine its 
policy rules. A typical policy will involve processing all packets of a TCP/IP session 
identically, and thus the poUcy manager may send information to the IPSEC engine 

20 that allows it to recognize future packets belonging to the same TCP/IP session as 
regular packets, and process them accordingly. Both the routine policy decisions for 
the following regular packets and their processing (e.g., encryption) take place in 
the IPSEC engine. The IPSEC engine applies transformations to the packets using 
cryptographic keys and other data it has received from the policy manager, or 

25 possibly from the key managers block through the policy manager. 

There are also other actions besides routine poUcy decisions that need to be 
performed per packet. For instance, a security association may have a limited 
lifetime defined by the amount of data transmitted using that security association, 
implying that the amoimt of data already transmitted must be recorded and the 
30 transmission must be dropped or the establishing process of a new security 
association mixst be initiated if the lifetime expires. Data transmission statistics may 
need to be updated for every packet. All these actions are preferably performed by 
the IPSEC engine. 

There are two types of information the policy manager sends to the IPSEC engine: 
35 security association parameters and compiled filter code. Security association 
parameters are information that are needed to apply an IPSEC transform (e.g., AH 
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or ESP) on a packet. The parameters include such data as encryption keys, 
authentication keys, initialization vectors, reply prevention counters, tunneling 
information, and any other data that may be necessary to parameterize a 
transformation. The compiled filter code, on the other hand, is an executable (or 
5 interpretable) representation of some aspects of the security policy. 

Fig. 4 illustrates in table form the main data items to be stored in a security 
association. Cell 401 includes selectors constraining the security association. Cell 
402 identifies the transformation that should be applied to the packets belongmg to 
the security association and cell 403 includes the key material needed in the 
10 transformation. Cell 404 includes replay prevention data for the transmission and 
cell 405 indicates the number of bytes transmitted. Cell 406 includes the expiration 
time and data transfer limit of the security association. 

Security association parameters must be stored in the IPSEC engine separately for 
each security association, as each association typically has different encryption and 

15 authentication keys. Filter code, on the other hand, is typically stored separately for 
each network interface, with separate code for incoming and outgoing packets. The 
reason for this is that storing the code separately for each interface eliminates the 
possibilites for a hostQe attacker to make a packet look like it had arrived from a 
different interface than it actually did. Additionally, code paths in the filter code 

20 will be shorter this way, making execution faster. 

Information in the IPSEC engine actually acts as a cache for information stored in 
the policy manager. In other words, it is the poUcy manager that has authoritative 
information about active security associations. It may, at its discretion, send some of 
that data to the IPSEC engine, and create filter code that processes packets for those 

25 security associations in the filter code, and passes packets for other, less frequently 
used associations to the policy manager, so that the pohcy manager can then install 
the associations and filter code needed for those packets in the BPSEC engme before 
reprocessing the packet. This allows fixed memory allocation in the IPSEC engine, 
making resource exhaustion attacks against the operating system kernel impossible. 

30 The filter code can also cache the fact that certain types of packets are to be 
rejected, shortcircuiting the processing of unacceptable packets. 

A simple preferable embodiment of a method according to the invention is 
summarized as a flowchart in Fig. 5. Blocks 501 and 502 correspond to the 
operation of the packet interceptor 303 in Fig. 3, i.e. letting only IP packets reach 
35 the IPSEC engine. Blocks 503 to 507 describe operations that take place in die 
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IPSEC engine. In block 503 the IPSEC engine applies tiie filter code it has 
previously stored. Applying the filter code in block 503 may include perfonning 
transformations on the packet, but this is not required by tiie invention. During the 
application of the filter code, the validity of the information stored in the IPSEC 

5 engine is also checked in block 503 for possible security association lifetime 
expirations or other invalidities. If die packet is a regular packet, the IPSEC engine 
knows whether it should drop the packet according to block 504 or accept it 
according to block 505; an accepted packet is ou^ut according to block 506. If the 
application of the filter code involved performing a transformation or otherwise 

10 processing the packet, block 506 corresponds to outputting the processed packet. If 
the answer in block 505 was no, the packet is non-regular and it must be transferred 
according to block 507 to the policy manager for examination and policy rule 
determination according to block 508. The resulting new policy decisions are stored 
into the IPSEC engine at block 509 in die form of compiled filter code and the 

15 operation continues fi-om block 503: the packet that caused the visit to blocks 508 
and 509 has now become a regular one because the newly stored compiled filter 
code contains information about how the packet should be treated. 

The policy manager may also process a received non-regular packet by itself as an 
alternative to compiling new filter code and communicating it to the IPSEC engine. 

20 The designer of die policy manager may decide, what kind of non-regular packets 
are worth compiling new filter code and what kind of packets are most 
advantageously processed in die policy manager. Additionally the policy manager 
may process a received non-regular packet by itself and compile new filter code and 
communicate it to die IPSEC engine for the processing of further similar packets. 

25 The last alternative is especially applicable when the received packet is a key 
management packet. 

As explained previously, the filter code is most advantageously stored in the 
operating system kernel. It consists of simple operations that can be executed 
quickly. Examples of filter code operations include comparing a field in the packet 

30 header against a known value and branching based on the result of the comparison, 
optimized multiple-choice selections of values, applying a transformation and 
continuing, dropping a packet, passing the packet through in its current form, and 
passing the packet to the policy manager for further consideration. The filter code 
according to the invention is thus a generalisation of the traditional concept of 

35 evaluating boolean expressions. 
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The filter code in its preferred embodiment has several characteristics which are 
beneficial: 

- It is linear byte code, which means that it can easily be stored and passed around 
in a memory buffer or array. 

5 - All jumps in the byte code are forward, which impUes that the filter code will 
always eventually tenninate. It is easy to make the interpreter very robust. 

- There are no loops in the filter code. For example, if two transforms are to be 
appUed inside each other, separate filter code is generated to process allowed values 
after the first application. This prevents resource exhaustion attacks by multiple 

10 layers of encryption using the same security association. 

There are also sitaations where processing packets in fi-agmented form is desirable. 
For example, if packets are to be tunneled inside a tunnel-mode AH or ESP 
transformation, it may not be desirable to reassemble the packets before applying 
the transformation, but to instead apply the tunneling transformation separately for 
15 each firagment. 

The filter code in the IPSEC engine can be used for this purpose as weU. The filter 
code can be applied to the first Augment of the packet as soon as the fragment has 
been received. A special filter code instruction can be used to abort processing if the 
full packet is needed. This instruction can be used in those code paths of the filter 

20 code that actually require a fiill packet. Those code paths that can process individual 
fragments (e.g., by applying a tunneling transformation, passing them through 
unmodified, or dropping them) do not include this instruction, and only access the 
part of the packet header that is always guaranteed to fit in the first fragment. 
Information will then be saved outside the fUter code to process other fragments of 

25 the same packet using the same methods as for the first fragment. 

The filter code described herein as interpreted may also be compiled into directiy 
executable machine code by the poUcy manager, thus sending actixal executable 
processor instructions to the IPSEC engine. 

Many optimizations on the executable programs are well known in the programming 
30 language and compiler literatiue, and have not been described here even though 
they apply to the filter code of this invention equally well as to other representations 
of programs. Methods for generating intermediate code from the set of rules are also 
well developed in the literatvue and known to tiiose skilled in the art. 
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It is well-known to those skilled in the art that it is possible to structure the 
implementation quite differently from Fig. 3 without changing the essential content 
of this invention. For example, it is possible to implement the IPSEC engine and 
policy manager intermixed in the same module, or to implement the policy manager 
5 on above of key managers. 

Even though the invention was described in the context of the IPSEC protocol, it is 
also applicable to other cryptographic security protocols that encrypt data on the 
packet level. In that case all IPSEC-related definitions in the previously presented 
description must naturally be changed to the corresponding definitions in the other 
10 security protocol. 

Figs. 6a and 6b illustrate a data processing system 600 and a gateway device 650 
that can be used to reduce the invention into practice. The system 600 of Fig. 6a has 
an TCP/IP adapter 601 for connecting into a network 602. A microprocessor 603 
uses the TCP/IP adapter 601 to transmit and receive information over the network 

15 602. The microprocessor 603 has a core memory 604 for storing the operating 
system kernel during use, and a separate, usually larger storage 605 for miming 
user-mode processes. The memory blocks 604 and 605 may be implemented as parts 
of a single memory circuit; alternatively at least a part of one and/or the other may 
be located on the same chip with the microprocessor 603. A nonvolatile mass 

20 memory 606 is also inlcuded for storing programs and data. Taken that the structure 
of Fig. 3 is employed, the packet interceptor and the IPSEC engine reside in the core 
memory 604 along with the rest of the operating system kemel, and the policy 
manager and key managers block of Fig. 3 use the storage 605 for their operation. 

The gateway device 650 is otherwise similar to the data processing system 600 but 
25 it contains two network adapters 65 1 and 652, one for connecting into an intemal 
network 653 and one for connecting into a general data transfer network 654. The 
gateway device 650 is used to implement the IPSEC sectirity features to protect the 
inhouse network 653 against attacks originating in the general data transfer network 
654. 

30 The devices of Figs. 6a and 6b are naturally shown as examples only and they do 
not limit the invention. The data processing system 600 and the gateway device 650 
may include other parts than those shown in Figs. 6a and 6b. 
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CLAIMS 

1. A data processing system for implementing a secvirity protocol based on 
processing data in packets, characterized in that said data processing system 
comprises: 

5 - packet processing means (308) for storing filter code (304) and processing data 
packets (301) according to stored filter code, and 

- policy managing means (305) for generating filter code and communicating 
generated filter code to said packet processing means, 

wherein said packet processing means is arranged to examine (503, 504, 505), 
10 whether the stored filter code is applicable for processing a certain packet, and to 
communicate (507) such packets for the processing of which the stored filter code is 
not applicable to said policy managing means, and said policy managing means is 
arranged to, as a response to receiving a packet firom said packet processing means, 
either (508, 509) 

15 - generate filter code applicable for the processing of the packet and communicate 
the generated filter code to said packet processing means, or 

- process the packet by said policy managing means, or 

-process the packet by said policy managing means and generate filter code 
applicable for the processing of the packet and communicate the generated filter 
20 code to said packet processing means. 

2. A data processing system according to claim 1, characterized in that it fiirther 
comprises a policy database (306) for storing a plurality of policy rules, wherein 
said policy database is implemented as a part of said policy managing means (305). 

3. A data processing system according to claim 2, characterized in that it further 
25 comprises key management means (307) for implementing the key management 

fimctions according to said security protocol, wherein said key management means 
is arranged to communicate with said policy managing means (305). 

4. A data processing system according to claim 3, characterized in that said key 
management means (307) and said policy managing means (305) are arranged to 

30 generate and maintain a plurality of security associations as specific applications of 
said policy rules and key management fimctions to certain communications. 
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5. A data processing system according to claim 4, dbaracterizedl in that said policy 
managing means (305) is arranged to generate filter code on the basis of the 
infomiation contained within said policy rules and said security associations. 

6. A data processing system according to claim 5, characternzed in that said policy 
5 managing means (305) is arranged to communicate information about said security 

associations to said packet processing means (301) in addition to the generated filter 
code, and said packet processing means (301) is arranged to perform cryptographic 
transformations on packets, said cryptographic transfomiations being based on said 
filter code and said infomiation about said security associations. 

10 7. A data processing system according to claim 6, characterozedl in that said policy 
managing means (305) is arranged to communicate information about only a 
fraction of the security associations known to said policy managing means (305) to 
said packet processing means (301). 

8. A data processing system according to claim 6, ctoaracterEsed in that said packet 
15 processing means (301) is arranged to store the filter code (304) separately from 

said information about said security associations, 

9. A data processing system according to claim 1, dharactterazed in that it further 
comprises packet intercepting means (303) for separating data packets for the 
processing of which said security protocol is applicable from a general stream of 

20 packets, wherein said packet intercepting means (303) is arranged to communicate 
with said packet processing means (301). 

10. A data processing system according to claim 1, characterized in that it fiirther 
comprises a kernel space (604) and a user-mode process space (605), wherein said 
packet processing means (301) resides in said kernel space (604) and said policy 

25 managing means (305) resides in said user-mode process space (605). 

11. A data processing system according to claim 1, cfearactterked in that it finther 
comprises a kernel space (604) and a user-mode process space (605), wherein said 
packet processing means (301) and said policy managing means (305) reside in said 
user-mode process space (605). 

30 12. A data processing system according to claim 1, cfearaciterized in that it fiirther 
comprises at least two network interfaces (651, 652), wherein said packet 
processing means (301) is arranged to store separate filter code for each network 
interface. 
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13. A data processing system according to claim 1, characterized in that said 
packet processing means (301) is arranged to process incoming and outgoing 
packets and store separate filter code for the processing of incoming and outgoing 
packets. 

5 14. A data processing system according to claim 1, characterized in that said filter 
code does not contain any backward jumps. 

15. A data processing system according to claim 1, characterized in that said filter 
code includes the operations of dropping a packet (504), passing a packet through 

(505) , and referring the packet to the policy managing means (507). 

10 16. A data processing system according to claim 15, characterized in tfiat said filter 
code additionally includes the operation of applying a transformation to a packet 

(506) . 

17. A data processing system according to claim 1, characterized in that said 
packet processing means (301) is arranged to process packets in fi-agments, applying 

15 said filter code to the processing of flie first firagment of a packet before receiving 
the other fi-agments and processing any remaining fragments of the packet 
separately using the actions determined for the first firagment. 

18. A data processing system according to claim 17, characterized in diat said filter 
code contains an instruction to require, as a response to receiving a fragment, a full 

20 packet before processing can continue. 

19. A data processing system according to claim 1, characterized in that said filter 
code consists of actual compiled processor instructions. 

20. A method for implementing a security protocol based on processing data in 
packets, characterized in that it comprises the steps of: 

25 a) examining (502, 504, 505), whether a piece of stored filter code is applicable for 
processing a certain packet in a packet processing means, whereby a positive result 
means that a a piece of stored filter code is appUcable for processing a certain 
packet and a negative result means that a piece of stored filter code is not applicable 
for processing a certain packet, 

30 b) following a positive resvdt in step a), processing (503, 506) the packet in said 
packet processing means according to the stored filter code. 
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c) following a negative result in step a), commtmicating (507) the packet into a 
policy managing means and examining (508), whether filter code should be 
generated and communicated to said packet processing means for the processing of 
the packet in said packet processing means, whereby a positive result means that 

5 filter code should be generated and communicated to said packet processing means 
and a negative result means that filter code should not be generated and 
communicated to said packet processing means, 

d) following a positive result in step c), generating (509) filter code applicable for 
the processing of the packet and communicating the generated filter code to said 

10 packet processing means, 

e) following a negative result in step c), examining, whether filter code should be 
generated and communicated to said packet processing means for the processing of 
fiulher similar packets in said packet processing means, whereby a positive result 
means that filter code should be generated and communicated to said packet 

15 processing means and a negative result means that filter code should not be 
generated and communicated to said packet processing means, 

f) following a positive result in step e), processing the packet in the policy managing 
means and generating filter code appUcable for the processing of fiuther similar 
packet and commimicating the generated filter code to said packet processing 

20 means, and 

g) following a negative result in step e), processing the packet in the policy 
managing means. 
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